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GLOM WIDGET 

Background of the Invention 

Some personal computers allow a user to "write" on their computer 
5 display much as they would write on their notepad. One such computer is a tablet PC 
which typically includes the functionality of a laptop computer but including more input 
features. For example, a tablet PC allows multi-modal input in which a user can input 
information into the tablet by writing on the touchscreen with a pen, using a keyboard, 
or even using their voice. A user can take notes just as they would using traditional pen 
10 and paper. Handwriting recognition allows the user's handwriting to be converted into 
digital text. The form factor of a many touchscreen PCs, however, requires a user to 
move their entire arm and hand to access the menus and toolbars when they want to 
perform some sort of command. This is much more difficult and tiring than just moving 
your hand and wrist a little bit with a mouse on a traditional PC. 

15 Summary of the Invention 

Generally, the present invention is directed at providing a glom widget 
that provides the pen user of a PC contextual tools near a location where they are 
writing on the touchscreen. 

According to one aspect of the invention, the glom widget is placed next 
20 to the node handle associated with the current handwriting. The glom widget is placed 
such that a user may easily access it without excessive movement of their arm. 

According to another aspect of the invention, when the user selects the 
glom widget, a context menu opens that contains several of the most common tools 
and/or commands that a user creating handwriting might want to access. The contextual 
25 commands are generally easier to comprehend and use since they are presented directly 
next to the content on the screen to which they relate. 
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According to yet another aspect of the invention, the menu may be 
modified. For example, a user may customize the menu to contain commands they 
commonly use. 

Brief Description of the Drawings 

5 FIGURES 1 illustrates an exemplary PC computing device that may be 

used according to exemplary embodiments of the present invention; 

FIGURE 2 shows an exemplary screen including a glom widget; 
FIGURE 3 shows an exemplary screen including a glom widget menu; 

and 

10 FIGURE 4 illustrates a process for utilizing a glom widget, in 

accordance with aspects of the invention. 

Detailed Description of the Preferred Embodiment 

Generally, the present invention is directed at providing a glom widget 
near where they are writing on the display. The glom widget provides the pen user of a 
15 PC contextual tools near where they are writing. The glom widget is positioned such 
that user movement is decreased in selecting tools and/or commands when writing on a 
screen. 

Illustrative Operating Environment 

20 With reference to FIGURE 1, one exemplary system for implementing 

the invention includes a computing device, such as computing device 100. In a very 
basic configuration, computing device 100 typically includes at least one processing 
unit 102 and system memory 104. Depending on the exact configuration and type of 
computing device, system memory 104 may be volatile (such as RAM), non-volatile 

25 (such as ROM, flash memory, etc.) or some combination of the two. System memory 
104 typically includes an operating system 105, one or more applications 106, and may 
include program data 107. A pen and ink interface allows a user to enter writing 
directly on the touchscreen. In one embodiment, application 106 may include a glom 
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widget application 120. This basic configuration is illustrated in FIGURE 1 by those 
components within dashed line 108. 

Computing device 100 may have additional features or functionality. 
For example, computing device 100 may also include additional data storage devices 
5 (removable and/or non-removable) such as, for example, magnetic disks, optical disks, 
or tape. Such additional storage is illustrated in FIGURE 1 by removable storage 109 
and non-removable storage 110. Computer storage media may include volatile and 
nonvolatile, removable and non-removable media implemented in any method or 
technology for storage of information, such as computer readable instructions, data 

10 structures, program modules, or other data. System memory 104, removable 

storage 109 and non-removable storage 110 are all examples of computer storage 
media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, 
flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or 
other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other 

15 magnetic storage devices, or any other medium which can be used to store the desired 
information and which can be accessed by computing device 100. Any such computer 
storage media may be part of device 100. 

Computing device 100 also includes input device(s) 112 such as a 
touchscreen input device, a stylus (pen), voice input device (speech recognition), an on- 

20 screen keyboard and writing pad, keyboard, mouse, etc. For example, a user could use 
the pen and writing pad to input their handwritten text into applications, and/or use the 
pen with the on-screen keyboard. Computing device 100 may also include Output 
device(s) 1 14 such as an external display, speakers, printer, etc. may also be included. 

Computing device 100 may also contain communication connections 116 

25 that allow the device to communicate with other computing devices 1 1 8, such as over a 
network. An exemplary communications connection is a wireless interface layer that 
performs the function of transmitting and receiving wireless communications. The 
wireless interface layer facilitates wireless connectivity between computing device 100 
and the outside world. According to one embodiment, transmissions to and from the 

30 wireless interface layer are conducted under control of the operating system. 



Communication connection 1 16 is one example of communication 
media. Communication media may typically be embodied by computer readable 
instructions, data structures, program modules, or other data in a modulated data signal, 
such as a carrier wave or other transport mechanism, and includes any information 
5 delivery media. The term "modulated data signal" means a signal that has one or more 
of its characteristics set or changed in such a manner as to encode information in the 
signal. By way of example, and not limitation, communication media includes wired 
media such as a wired network or direct-wired connection, and wireless media such as 
acoustic, RF, infrared and other wireless media. The term computer readable media as 
1 0 used herein includes both storage media and communication media. 

Glom Widget 

FIGURE 2 shows an exemplary screen including a glom widget, in 
accordance with aspects of the invention. As shown, screen 200 includes glom widget 
210, node handle 230, and exemplary writing 220. 

1 5 Glom widget 210 provides the pen user of a PC access to contextual 

tools near where they are writing. Glom widget 210 appears next to handwriting 220 
that an inking application recognizes. If the user clicks on the glom widget 210, a 
context menu (see FIGURE 3) drops down that contains several of the most common 
tools and/or commands that a user creating handwriting might want to access. 

20 According to one embodiment, the location of the glom widget is based on the input 

language. For example, for left-to-right language the glom widget may be placed on the 
left side of the handwriting and for right-to-left language the glom widget may be 
placed to the right of the handwriting. According to one embodiment, the glom widget 
appears on the first line of the current paragraph just to the left (1/8 of an inch) of the 

25 node handle for left-to-right handwriting. The glom widget, however, may be placed 
anywhere that is near where the user is writing that does not interfere with the user's 
writing. For example, the glom widget may be placed somewhere around the text. The 
location on the right of writing 220 may be useful for right-to-left languages. Glom 
widget 210 is placed such that a user may easily access it without excessive movement 

30 of their arm. According to one embodiment, glom widget 210 is placed closest to the 



writing before any other icons are placed. For example, if an audio clip icon exists then 
the clip icon is rendered to the left of the glom widget. According to another 
embodiment, the user may also specify where they want the glom widget to appear. For 
example, the user could specify to place the glom widget a quarter of an inch above the 
5 current writing. 

FIGURE 3 shows an exemplary screen including a glom widget menu, in 
accordance with aspects of the invention. As shown, screen 300 includes glom widget 
310, node handle 230, writing 220, and menu 320. 

If the user hovers over the glom widget 210 (as it is shown in FIGURE 
10 2), the glom widget changes to a hover shape as illustrated by glom widget 310. The 
hover behavior of the glom widget appears based on the pens proximity over the glom 
widget icon and changes slightly when the pen hovers over the top of it. 

Once glom widget 310 is clicked on by the user, context menu 320 drops 
down and contains several of the most common tools and/or commands that a user 
15 creating handwriting might want to access. Menu 320 can also contain contextual 

commands that are easier to comprehend and use since they are presented directly next 
to the content on the page to which they relate. 

Glom widget menu 320 may include any tools and/or commands that 
help the user. According to one embodiment, menu 320 consists of a set of common 
20 tools and commands a pen user uses when writing handwriting on the PC input screen. 
These include: Bullets; Numbering; Spacer; Merge paragraph with one above; Split last 
line into new paragraph; Treat Ink as Drawing; Pen (cascade with pen list); Select; 
Erase; and Cancel which dismisses glom widget menu 320. Menu 320 may also include 
a list of commands defined by the user. For example, the user could customize menu 
25 320 to only include a subset of the illustrated commands. The user could also add 
additional commands to menu 320. 

The bullets and numbering command allows a user to add bullets or 
numbering to existing lines of text or the user can create a bulleted list automatically as 
they type or write. 
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The merge paragraph command allows a user to merge a node with 
another. According to one embodiment, the merge command merges the present node 
with the node above. The merge command is active when the paragraph above is at the 
same level as the one the user is in (paragraph corresponding to the widget they clicked, 
5 could be any individual line from a multi-line paragraph), and when clicked it merges 
the current paragraph with the one above. 

The split command is active on multiple line paragraphs. When selected 
it inserts a carriage return at the front of the last line in the paragraph. For example, if 
you had a paragraph that looked like this, 
10 1. This is a sample paragraph of more than one line. The part that is 

split is the portion on the second line. 

Selecting the split command results in the following, 

1. This is a sample paragraph of more than one line. The part that is 

2. split is the portion on the second line. 

1 5 The treat ink as drawing instructs the PC to not interpret the writing as 

text. Another command, "Treat ink as Text" may also be included in the menu to 
instruct the writing to be treated as text. 

The pen command allows a user to select from a palette of pens that may 
be available to the user. The select command selects the current node. The erase 

20 command erases the current node, and the cancel command exits menu 320. 

FIGURE 4 illustrates a process for utilizing a glom widget, in 
accordance with aspects of the present invention. After a start block, the process flows 
to block 410 where the current writing location is determined. The current writing 
location is determined so that the glom widget may be placed in close proximity. 

25 Moving to block 420, the glom widget is placed in close proximity to the 

writing location. According to one embodiment, the location of the glom widget is 
based on the input language. For example, for left-to-right language the glom widget 
may be placed on the left side of the handwriting and for right-to-left language the glom 
widget may be placed to the right of the handwriting. The location of the glom widget 

30 may be placed in any location near the writing that does not interfere with the user's 
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writing. The glom widget is placed such that user movement is reduced as compared to 
accessing the menu or tool bar for the writing window. 

Transitioning to block 430, a determination is made as to when the glom 
widget is selected. According to one embodiment, the glom widget is selected when a 
5 user clicks on the widget. According to one embodiment, when a user hovers over the 
glom widget it changes visual appearance slightly to provide feedback to the user. 

Once selected, the process moves to block 440 where the glom widget 
menu is displayed. The menu provides the user with a set of commands without having 
to move their arm excessively across the display to select a menu. The process then 
10 steps to an end block and returns to processing other actions. 

The above specification, examples and data provide a complete 
description of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and scope 
of the invention, the invention resides in the claims hereinafter appended. 

15 
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